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Autoregressive  Spectral  Estimation  in  Additive  Noise 

DONALD  F.  GINGRAS,  member,  ieee,  and  ELIAS  MASRY,  fellow,  ieee 


Abstract— The  estimation  of  the  spectral  density  of  a  discrete-time 
stationary  Gaussian  autoregressive  (AR)  process  from  a  finite  set  of 
noisy  observations  is  considered.  A  modified  spectral  estimator  based 
oil  the  high-order  Yule-Walker  equations  is  considered.  Joint  asymp¬ 
totic  normality  of  this  spectral  estimator  is  established;  a  precise 
asymptotic  expression  for  the  covariance  matrix  of  the  limiting  distri¬ 
bution  is  obtained.  The  special  case  of  AR(1)  plus  noise  is  considered 
in  some  detail. 

1.  Introduction 

N  this  paper,  the  problem  of  estimating  the  spectral 
density  of  a  discrete-time  stationary  Gaussian  autore¬ 
gressive  (.\R)  process  from  a  finite  set  of  noisy  observa¬ 
tions  is  considered.  AR  spectral  estimation  techniques  are 
widely  used  in  signal  processing  applications.  They  are 
meaningful  when  the  underlying  process  is  well  modeled 
by  an  AR  random  process  and  the  resulting  spectral  esti¬ 
mate  will  e.xhibit,  for  small  sample  size,  increased  reso¬ 
lution  (see  Kaveh  and  Cooper  [1]  and  Beamish  and 
Priestly  [2])  over  that  obtained  by  the  nonparametric 
smoothed  periodogram.  In  practice,  the  observ'ation  pro¬ 
cess  has  a  noi.se  component  and  the  usual  noise-free  AR 
spectral  estimate  is  no  longer  adequate,  especially  when 
the  signal-to-noise  ratio  is  low.  A  modified  estimate  is 
considered  and  its  asymptotic  statistical  properties  are  de¬ 
veloped. 

Let  X  =  {X„}^^  be  a  real-valued  autoregressive 
process  of  order  p,  AR(p),  with  spectral  density  0(  X) 
and  let  {  be  a  white  noise  process.  The  ob¬ 
served  process  T  =  {  is  defined  by  {  T„  =  -f 

fV„}  and  let  X)  denote  its  .spectral  density.  The  prob¬ 
lem  being  considered  is  the  estimation  of  the  spectral  den¬ 
sity  0{  X)  of  the  AR(/;)  process  X  from  a  finite  set  of 
noisy  observations  {  . 

For  the  noise-free  case,  the  asymptotic  stati.stics  for  the 
estimates  of  the  AR  parameters  were  rigorously  estab¬ 
lished  by  Mann  and  Wald  [3].  They  proved  that  the  esti¬ 
mates  were  consistent,  that  their  limit  distribution  was 
normal  and  calculated  the  asymptotic  covariance.  Akaike 
[4],  starting  with  the  asymptotic  results  of  Mann  and  Wald 
[3]  for  the  parameters’  estimates,  and  assuming  that  the 
order  p  is  known,  proved  that  the  asymptotic  distribution 
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for  the  corresponding  AR  spectral  estimate  is  normal  and 
calculated  its  covariance.  Berk  [5],  under  the  assumption 
that  the  order  of  the  AR  process  goes  to  infinity  as  the 
number  of  observations  tends  to  infinity,  proved  that  the 
distribution  of  the  AR  spectral  estimate  is  asymptotically 
normal  with  asymptotic  variance  identical  to  that  of  a 
truncated  periodogram. 

The  problem  of  AR  parameter  estimation  for  the  AR 
plus  noise  case  was  first  examined  by  Walker  [6]  who 
evaluated  the  asymptotic  efficiency  and  variance  for  the 
parameter  estimate  of  a  first-order  AR  process.  Pagano 
[7] ,  noting  that  the  correct  model  for  an  AR  (p)  plus  noise 
process  is  an  autoregressive-moving  average  (ARMA) 
process  of  order  (p,  p),  developed  strongly  consistent  and 
efficient  AR  parameter  estimates  through  the  use  of  non¬ 
linear  regression.  Lee  [8]  examined  the  multivariate  AR 
plus  noise  case  and  proved  asymptotic  normality  for  es¬ 
timates  of  the  AR  parameters  based  on  the  high-order 
Yule-Walker  equations.  However,  his  results,  which  de¬ 
pend  on  a  central  limit  theorem  of  Billingsley  [9],  are  not 
substantiated  as  shown  in  Section  V.  For  the  univariate 
AR(p)  plus  noise  case,  asymptotic  normality  for  esti¬ 
mates  of  the  AR  parameters,  based  on  the  high-order 
Yule-Walker  equations,  was  established  by  Gingras  [lOJ. 

In  this  paper,  we  consider  the  estimation  of  the  spectral 
density  0(  X)  of  an  autoregressive  process  ARfj?)  from 
a  finite  set  of  noisy  observations;  the  SpCCt  ral  estimate 
0jv(^)  utilizes  AR  parameters’  estimates,  based  on  the 
high-order  Yule- Walker  equations.  The  goal  of  the  paper 
is  to  establish  the  asymptotic  statistics  of  the  spectral  es¬ 
timate  0;^(X).  The  organization  of  the  paper  is  as  fol¬ 
lows.  In  Section  II,  the  basic  assumptions  are  set  down; 
the  estimates  for  the  parameters  and  the  spectral  density 
(  X)  are  defined.  The  main  results  are  presented  in  Sec¬ 
tion  III  where  the  joint  asymptotic  normality  of  (  ^)  is 
established  along  with  an  expression  for  the  asymptotic 
covariance.  In  Section  IV,  the  special  case  of  AR(1)  plus 
noise  is  considered  in  some  detail,  and  a  performance 
comparison  to  the  noise-free  case  is  presented.  Appendi.x 
A  contains  the  proofs  of  certain  lemmas  used  in  the 
derivation  of  the  main  results,  and  Appendix  B  contains 
detailed  calculations  of  variance  and  covariance  expres¬ 
sions.  Throughout  this  paper,  vectors  are  denoted  by  lower 
case  letters  and  matrices  are  denoted  by  upper  case  letters; 
both  are  indicated  by  boldface  type. 

11.  Preliminaries 

Throughout  this  paper,  the  signal  X  =  is 

assumed  to  be  a  stationary  Gaussian  AR(/))  process.  Such 
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a  process  has  the  representation 


X„  - 


^pXfi  ~ p 


n  =  0,  ±1, 


(1) 


where  the  innovations  process  { }  is  a  sequence  of  in¬ 
dependent  identically  distributed  Gaussian  random  vari¬ 
ables  91(0,  a]).  The  AR  parameters  {oj  are  con¬ 
strained  such  that  the  polynomial 

p 

A(c)  =  -  S  CjZ^  (ao  =  -1) 

;  =  o 


has  no  zeros  inside  the  closed  unit  circle  {z:  j  z  1  <  1  }■ 
The  spectral  density  0(  X)  of  the  process  X  is  given  by 


0(X)  = 


o]I2tp 


1  -  a,  e 


j  =  ' 


(2) 


The  noise  process  W  =  {  is  assumed  to  be  a 

sequence  of  independent  identically  distributed  Gaussian 
random  variables  91(0,  Moreover,  the  processes  X 
and  W^are  assumed  to  be  independent. 

The  observation  process  Y  -  {  i'n  }  is  defined  by 

T„=X„+PT„;  n=0,  ±1.  •••• 

The  spectral  density  0(  X)  of  the  process  {  K,, }  is  given 
by 

t/'l  X)  =  aw/2i:  +  0(  X).  (3) 

The  process  Y  is  then  an  ARMA(/7,  p)  series  with  rep¬ 
resentation  (see  Walker  [6]  and  Pagano  [7]) 

~  rj  1  _  I  ~  ■  ■  ■  ~  cipY„.p 

=  e,  +  -  ■  ■  ■  -  OpW^^p  (4) 

for  all  n.  Denote  the  covariance  sequence  of  the  series  Y 
by  { r^ }  where  =  E[Y„Y„,k]-  Multiplying  (4)  through 
by  and  taking  expectations,  we  obtain  the  Yule- 

Walker  ( Y-W  )  equations; 


n,  - 


OpTp  —  (j;  -I-  a'w 


(5) 


for  1  <  k  ■<  p 

(6) 

“  ■  ■  ■  ~  Op =  0-  for  A:  ^  p  -f-  I. 

(7) 


n 


R  = 


I 


(9) 


and  the  ( p  x  1 )  vectors  a  and  b  are  defined  by 

a  =  (a,,  Ui,  ■  ■  ■  ,  Opf 

*  =  ('■p+l.  '>4-2,  •  •  •  .  l-lpf- 

Given  a  finite  set  of  noisy  observations  {  i ,  A/  > 
2p,  we  estimate  the  covariance  sequence  {r^}  using 

f  Af-ILI 

(1//V)  E  IM  ^  ^  -  1 

r.M.k  =  \  ' 

^0,  Ikl  >  iV  -  1.  (10) 

When  the  elements  of  the  matrix  R  and  vector  b  are  re¬ 
placed  by  their  corresponding  estimates  (10),  the  esti¬ 
mated  matrix  and  vector  will  be  denoted  by  /?,v  and  6,v. 
respectively.  Using  the  high-order  Yule-Walker  equa¬ 
tions  (8),  we  define  the  vector  estimate  dy  of  the  AR  pa¬ 
rameters  as  the  solution  of  the  equation 

Rydy  —  by.  (  1  1  ) 

To  estimate  the  AR  spectral  density  0(  X),  we  require 
estimates  of  the  AR  parameters  such  as  those  formed  by 
(11)  and  an  estimate  of  cr,.  An  estimate  of  can  be  ob¬ 
tained  by  first  using  (5)  to  provide  an  estimate  of  -f 
a^  and  then  using  one  of  the  equations  (6),  say  A:  =  p,  to 
obtain  an  estimate  for  This  yields 

p  p 

=  -  E  dyjPy^j  -  {\/dy  )  E  Qyjfy  j  (l2) 

7  =  0  7  =  0  ' 


where  dy  q  =  -  1  since  =  —  1 .  Note  that  for  large  N, 
dy  p  is  necessarily  nonzero  since  dy_p  converges  almost 
surely  to  Op  (see  Lemma  1  in  Section  III  below),  and  Op 
^  0  since  the  order  of  the  process  X  is  p.  The  spectral 
estimate  0,v  (  X)  is  now  defined  by 


0,v(  X)  = 


ol.,/2ir 


(13) 


1  —  E  «v 


7  =  1 


•V.y  ^ 


-ij\ 


For  the  sake  of  compactness  of  notation,  we  let 

0  =  ((7,\  a^.  •  ■  ■  ,  GpV  ( 14a) 

be  the  vector  of  parameters  to  be  estimated  and  0%  be  its 
estimate 


The  .set  of  p  equations  in  (7)  corresponding  in  k  =  p  + 
1,  •  ■  •  ,  2p  is  often  referred  to  as  the  high  order  Yule- 
Walker  equations.  We  express  this  set  in  matrix  form  as 

/?a  =  A  (8) 

where  the  ( p  x  p  )  covariance  matrix  R  is  defined  by 


9.V  —  ^,v,  !■  ■  ■  ■  .  Q,v.p)  ■  (l4b) 

In  the  subsequent  development  of  asymptotic  statistical 
properties  for  the  parameter  and  spectral  density  esti¬ 
mates,  we  make  use  of  the  following  vectors  and  matri¬ 
ces,  some  of  which  have  been  defined  previously,  but  are 
presented  here  for  convenient  reference; 
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II 

0 

.  r2pV 

(15a) 

b  =  (/-p.i,  Tp^,. 

(15b) 

a  =  (a,,  ai,  •  ■  • 

(15c) 

d  —  ( Up ,  flp  _  1 , 

(15d) 

d  =  (ro,  M,  •  ■  • 

.  rp)' 

(15e) 

1 

II 

(15f) 

V{\)  =  [u*,(X)]S. 

0 

(15g) 

u*,,(\)  =  +  e' 

ik  -J)X 

0  =  (0,  0,  •  •  ■  , 

of 

(15h) 

where  the  dimension  of  the  null  vector  0  will  be  clear  by 
the  context  in  which  it  is  used. 

In  the  next  section,  we  make  repeated  use  of  the  follow¬ 
ing  results,  regarding  convergence  in  probability  -►  and 

£ 

convergence  in  distribution  the  proofs  of  which  can 

be  found  in  Rao  [11]. 

Proposition  1:  For  each  integer  N  >  1 ,  let  %  and  i^y 
be  random  vectors  and  let  a  and  p  be  constant  vectors; 

then 

^  n-  s,v  ^  0  =>  ^  0  (16a) 

ti,v  a,  C,v  p  =>  n.Uv  a''p  (16b) 

h.v  --  i;,v  I  ^  0,  i;,v  ^  ^  ( 16c) 

III.  Statistical  Properties 
In  this  section,  we  establish  the  joint  asymptotic  nor¬ 
mality  of  the  spectral  estimate  ^,v(X)  and  provide  a 
closed-form  expression  for  its  covariance  matrix  (Theo¬ 
rem  3).  Since  the  statistical  properties  of  the  covariance 
estimates  fv  *  (10)  are  well  known  (see  Brillinger  [12]), 
the  method  of  analysis  adopted  in  this  paper  is  to  establish 
asymptotic  equivalence  in  probability  between  the  error 
vector  (dv  -  a)  and  appropriate  linear  combinations  of 
{hv.L  “  (Lemma  2);  similarly,  we  establish  such 

an  equivalence  relationship  for  the  innovation  variance’s 
error  a ~  (Lemma  3).  Using  these  relationships,  the 
statistical  properties  of  the  errors  (d,v  -  a)  and  a.v,,  - 
a~  can  be  established  from  those  of  {fv,*}.  These  two 
lemmas  and  their  derivations  are  the  crux  of  the  analysis 
leading  to  the  main  result  (Theorem  3).  For  the  sake  of 
readability,  we  have  delegated  the  complex  derivation  of 
Lemma  3  (as  well  as  that  of  Lemma  2)  to  Appendix  A. 

A.  Statistics  of  Parameters'  Estimates 

It  should  be  noted  that  in  [10],  the  asymptotic  normality 
of  the  AR  parameters’  estimates  (dy)  was  established. 
However,  this  result  does  not  lead  directly  to  the  joint 
asymptotic  normality  of  ,  and  dy  in  view  of  the  depen¬ 
dence  of  ff  'v  (  on  fly  as  well  as  on  the  covariance  estimate 
{fyj  }.  Lemmas  2  and  3,  which  were  not  developed  in 
[10],  provide  an  appropriate  asymptotic  reduction  of  dy 


=  (dy  j,  dy)^in  terms  of  the  covariance  estimates  { fy^  }. 
This  reduction  makes  it  possible  to  establish  the  asymp¬ 
totic  normality  of  0y  and  provide  a  convenient  expression 
for  its  asymptotic  covariance  E.  In  principle,  one  could 
consider  expressing  dy ,  solely  in  terms  of  dy  (by  (12); 
this  would  require  writing  the  {  ryj  }  in  terms  of  dy  )  and 
then  applying  the  results  of  [10]  for  dy  to  establish  asymp¬ 
totic  normality  of  0y;  this  approach  does  not  appear  to  be 
simpler  in  terms  of  the  complexity  of  the  derivations.  In 
this  subsection,  we  establish  the  asymptotic  distribution 
for  0y.  First,  we  present  the  asymptotic  distribution  of  the 
covariance  estimates  of  (10)  as  established  by  Brillinger 
[12.  p.  256]. 

Theorem  1:  For  the  observation  process  Y,  the  covari¬ 
ance  estimate  fy  converges  in  quadratic  mean  to  r*  as  N 
00  with  covariance 

lim  N  cov  { f y  fy  } 

v-oo 

=  27r  (  -I-  (17) 

J  -  t 

Moreover,  the  standardized  estimates  A^''^^(fy  i  -  r,), 
-  '■2).  •  •  •  .  -  r„)  are  asymptoti¬ 

cally  Jointly  normal  with  zero  means  and  asymptotic  co- 
variance  given  by  the  right  side  of  (17). 

Thus,  the  standardized  vector  estimate  /V''  -(cy  -  c)  of 
(15a)  is  asymptotically  multivariate  normal  with  zero 
mean  and  covariance  matrix  given  by 

lim  cov  {/V'/^(cy  -  c),  /V'^‘(dy  -  c)^} 

N  -*  a» 

=  2ir  J  (18) 

The  following  lemma,  whose  proof  is  delegated  to  Ap¬ 
pendix  A,  establishes  the  almost  sure  convergence  of 
i?y'  and  dy  *  as  N  00.  We  remark  that  /?”'  exists  (see 
Gersch  [13]). 

Lemma  1:  i?y'  exists  almost  surely  for  large  N  and 
converges  lo  R~'  as  N  -*  00  almost  surely.  Moreover,  the 
AR  parameter  estimate  dy  *  converges  almost  surely  to  a* 
as  N  00  for  ^  =  1 ,  •  •  •  ,  p. 

We  next  construct  a  random  vector  'Zy  that  is  equiv¬ 
alent  in  probability  to  the  high-order  Y-W  AR  parameter 
estimate  vector  Af''^‘(dy  -  a).  The  proof  is  given  in  Ap¬ 
pendix  A. 

Lemma  2:  Define  the  vector  random  variable  Zy  by 

Zy  =  /?-'£>(Cy  -  c)  (19) 

and  the  matrix  D  by 
D 

0  -Up  -flp-i  ■  •  •  -a,  10  •  •  ■  0 

=  00  -Up  •  •  •  -a,  1  0  •  ■  •  0 

_0  0  •  •  ■  0  -Op  •  •  •  -fli  1  _ 
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Then 

N'  "I  (a.v  -  a)  -  2/v !  0  as  A/  ->  00.  (20) 

We  previously  established  an  estimate  (12)  for  the  vari¬ 
ance  a;.  The  next  lemma,  whose  proof  is  given  in  Ap¬ 
pendix  A,  establishes  the  existence  of  a  random  variable 

N'  '("v  that  is  equivalent  in  probability  to  ~ 

Lemma  3:  Define  the  random  variable  f/v  by 

r.v  =  A"(cv-c)  (21) 

where 

/.  =  (-(-l.a'.OM  -  (l/a,)(d".  -1,0") 

+  (l/a,)r/")[J‘_,]D 

+  {\/aJ{{-l,a^)d)[R-'D]y  (22) 

and  [A]p  denotes  the  pth  row  of  the  matrix  A.  Then 

A'-j(d'v.,  -  a:)  -  f.vl  -  0  as  A  -  oo.  (23) 

The  following  result  establishes  the  asymptotic  nor¬ 
mality  of  the  vector  estimate  0,v.  Its  proof  relies  on  the 
equivalence  relationships  of  Lemmas  2  and  3. 

Theorem  2:  The  standardized  {(p  +  1)  x  1)  vector 
estimate  A'  "(Ov  -  0)  is  asymptotically  multivariate  nor¬ 
mal,  that  is, 

A'  -(0v  -  0)  91(0.  E)  as  A  00 

where 

r  s  I  (24) 

Is  G  J 

and 

c-  =  Ztt  (  h^U(X)  /ii^-(X)  d\  (25) 


s  =  27r  j  R-'DUi\)  h^p\X)  d\  (26) 

G  =  27r  J  R-'DU(X)  D^{R-'ff'i>^)  dX.  (27) 

Note  that  the  dimensions  of  the  matrices  L  and  G  are  ( ( p 
1 )  X  ( p  f  1 ) )  and  ( p  X  p),  respectively. 

Proof:  By  definition,  we  have 

,  -.r  V , 

A'  -(Ov  -  0)  =  a'  '  '  ; 

I  dv  -a 

by  Lemma  2.  we  have 

a'  "|(dv  -  a)  -  z,v  I  -*  0  as  A  -♦  oc  (28) 
where  Zv  is  defined  in  (19).  Also,  by  Lemma  3,  we  have 
A'  -|(d,V,  -  a;)  -  tv!  ^  as  A  -  00  (29) 


where  is  defined  in  (21).  Thus,  it  follows  from  (28) 
and  (29)  that 

r  /t"  1 

A'^^  (0JV  -  0)  -  ,  (c/v  -  c)  0  as  A  00. 

From  Theorem  1,  we  have  that  A'^^(c^  -  c)  is  asymp¬ 
totically  multivariate  normal;  therefore,  by  (16c),  it  fol¬ 
lows  that  A'^"(0/v  -  0)  converges  in  distribution  to  a 
multivariate  normal  vector  with  zero  mean  and  covariance 
matrix  L  which,  by  (18),  is  given  by 

f  1 

U(X)lh,  D^(R-')^]  f'{X)  dX. 

i  R  'D  J 

(30) 

The  result  follows.  □ 

Theorem  2  establishes  convergence  in  distribution  of 
the  vector  estimate  A'’'^(0^  -  0).  It  should  be  noted  that 
£  is  the  covariance  matrix  of  the  asymptotic  distribution. 
This  does  not  necessarily  imply  that  the  covariance  of  the 
vector  estimate  A‘'^(0v  -  0)  converges  to  L  of  (30)  (see 
Serfling  [14,  p.  20]).  For  the  sake  of  simplicity,  however, 
we  refer  to  E  as  the  asymptotic  covariance  matrix  instead 
of  the  more  accurate  expression  “covariance  matrix  of  the 
asymptotic  distribution.”  Similar  terminology  is  used  in 
connection  with  the  asymptotic  properties  of  the  spectral 
estimate. 

The  components  of  the  asymptotic  covariance  matrix  L 
can  be  evaluated  using  expression  (3)  for  the  spectral  den¬ 
sity  fiX).  The  detailed  evaluation  of  these  terms  is  pre¬ 
sented  in  Appendix  B. 


B.  Statistics  of  Spectral  Density  Estimate 
We  now  establish  the  joint  limiting  distribution  of  the 
spectral  estimates  0,v  (  X, ),  •  •  •  ,  <^,v  (  X J  at  r  distinct  fre¬ 
quencies  X|,  •  •  •  ,  Xr-  We  make  use  of  the  following 
theorem  on  nonlinear  transformations  of  asymptotically 
normal  variates  (Serfling  [14,  Theorem  3.3A])  which  we 
recast  in  our  notation  in  the  next  lemma. 

Lemma  4:  Let  0,v  =  (0,v.  i<  '  '  '  .  0,v.m)^  be  jointly 
asymptotically  normal  random  variables  with  mean  vector 
0  and  covariance  matrix  L.  i.e., 

A'  '(0,v  -  0)  ^  91(0.  as  A  -  oo. 

Letg(j:)  =  (g|(x).  •  •  •  ,g,(x))",x  =  (.r,,  •  ■  •  ,.r„,)" 
be  a  vector-valued  function  for  which  each  component 
gkix)  is  real  valued  and  has  a  nonzero  differential  gj  0; 
T )  at  T  =  0: 


2  ^ 
yT"|  a.v,  ^ 


for  any  vector  t  =  (  ti  ,  •  •  ■  ,  ) ". 

Put 


r  = 


=  0.  .r 
=  0.  ■  , 
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Then 

g(0.v)  =  (.ifl(0,v)-  •  •  •  .  gri^s))^ 

is  jointly  asymptotically  normal  with  meang(0)  and  co- 
variance  matrix  rLr''.  i.e., 

A/'  ’(gCO.v)  -  g(e))  ^  91(0,  TEF^)  as  Af  ->•  00. 


Theorem  3:  The  standardized  spectral  density  esti¬ 
mates  /V'  "^  v  (  ).  ■  ■  •  .  A''  “<i)  v  (  Xr)  are  Jointly  asymp¬ 

totically  normal,  as  N  oo,  with  means  </>(  X,),  •  •  •  , 
</)(  XJ  and  covariance  matrix  FLr’",  i.e., 

N'  '[<iv(X,)  -  <i.(X,)].  ■  •  •  , 

N'  '[<^,v(X.)  -  0(X,)j  -  91(0,  FIF^)  (31) 
where  the  r  x  { p  +  1 )  matrix  F  is  given  by 

F  =  (p(X, ),-••,  (32a) 


and  the  (p  -f  1 )  X  1  column  vector  p(  X)  is  defined  by 
p(X)  =  0(X)[l/a^e^X)]^  (32b) 


with 

e(\) 


2  Re 


i  X 


J2X 


c‘P>' 


Aie‘^) 


(32c) 


Proof:  Let  m  —  p  A  1.  By  Theorem  2,  we  have  that 

y-(0,v  -  0)  ^  91(0,  E)  as  /V  ^  00  (33) 

where  0  and  O.v  are  given  by  (14).  Now  the  spectral  den¬ 
sity  di(  X* )  is  a  real-valued  function  of  the  parameter  vec¬ 
tor  p,  i.e.,  d>(  \)  =  p)  where 


<^>t(  n)  = 


Pq/Itt 


1  -  E 


y=  I 


2  • 


and  provides  explicit  expressions  for  the  variance/covari¬ 
ance  of  the  joint  asymptotic  distribution.  Using  the  de¬ 
composition  (24)  for  E,  we  have  that  the  asymptotic  co- 
variance  function  of  N‘^^[0jv(X)  -  0(X)]  and 

~  <^>(»')]  appearing  in  the  asymptotic  distri¬ 
bution  (31)  is  given  by 

acov  i>)  =  0(X)  <|)(p)  /a]) 

+  {  X)  s/a]  A  s^e{v)/a] 

+  c^(X)  Ge(p)},  (34a) 

and  if  we  set  X  =  p,  we  obtain  the  asymptotic  \  nance 
avar  (  X )  of  A/'  ^-[  0,v  (  X )  -  0  (  X )  ]  as 

avar  (  Xl  =  d)^(  X)  |(t’^/a^)  +  2e^ {  X)  s/a] 

+  e^(X)Ge(X)|  (34b) 

where  ,  s,  and  G  are  given  by  (25),  (26),  and  (27), 
respectively. 

Equations  (34a)  and  (34b)  represent  fundamental 
closed-form  expressions  for  the  asymptotic  variance  and 
covariance  functions,  appearing  in  the  joint  asymptoti¬ 
cally  normal  distribution  of  the  spectral  estimate  of  an  AR 
process  in  the  presence  of  additive  noise.  Their  complex¬ 
ity,  however,  does  not  allow  simple  interpretation.  Thus, 
in  the  next  section,  we  specialize  to  the  case  of  a  first- 
order  AR  process  and  examine  the  dependence  of  the 
asymptotic  covariance  function  acov  (X,  v)  on  the  fre¬ 
quencies  X  and  p  and  on  the  values  of  the  AR  parameter 


IV.  The  AR(1)  Case 

The  first-order  AR  process  has  the  representation 

X,  -aX,_,=e„  (35) 


It  is  seen  that  the  partial  derivatives 


dpj  ’ 


J  =  0,  1, 


exist  and  are  continuous  in  a  neighborhood  of  p 
Moreover,  the  gradient  vector 


Pt(0) 


90.(0) 

ddo 


90.(0) 
dd,  , 


0. 


is  given  by  (32b),  i.e.,  pt(0)  =  p(Xt).  We  note  that 
e(  X)  of  (32c)  actually  depends  on  0  via  /l(e'^)  which  is 
a  function  of  }j’=,  [cf.  (14a)].  Thus,  p(X)  of  (32b) 
depends  implicitly  on  0.  Since  at  least  the  first  component 
of  Pt(0)  is  clearly  nonzero,  it  follows  that  the  differential 

g.(0;  t)  =  p[(0) T 


is  nonzero  for  each  A:  =  1 ,  •  ■  •  ,  r.  Lemma  4  now  applies 
with  the  identification  gk(x)  =  0i(x),  and  the  result  fol¬ 
lows  from  (33).  □ 

Theorem  3  establishes  the  joint  asymptotic  normality  of 
the  scaled  spectral  estimate  errors  V'“[0,v(  X)  -  d)(  X)| 


where  the  AR  parameter  “a”  satisfies  the  condition  -  I 
<  a  <  1 .  The  spectral  density  for  d)(  X)  is  given  by 


0(X)  = 


_ o]/2-n- _ 

[a^  -  2a  cos  (X)  -I-  1  ] 


(36) 


In  this  case,  the  asymptotic  covariance  function  acov  (  X, 
p)  can  be  expressed  directly  in  terms  of  the  parameters  a, 
a],  a]v.  We  have 


acov  ( X,  p)  =  0(*')  I  ^,2 

■  [cos  (X)  —  a]  +  47rTd>(p) 

•  [cos  (p)  —  a]  -t-  (47r)^G(A(X)  0(p) 

■  [cos  (X)  -  a\  [cos  (p)  -  a]]  (37a) 

avar  (  X)  =  ^  |  v"  a  Sirs<t>{  X)  [cos  (X)  -  a] 

A  (4Tr)‘G0‘(X)[cos  (X)  -  a]’)  (37b) 
where  the  scalar  constants  G,  5,  and  v'  are  given  by 
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G  =  - -2 - 7 


s  =  %  I  -a^(  1  +  a^)  +  ( 1  +  a^)  7 

+  2(1  -  a^)(ai/ff^)7} 

3q^  +  1  _  2(1  +  a'^f 

a^{  1  -  a^)  a(l  -  a^) 

.(la*  -  I 


tr  =  a:\\  + 


2\- 


+ 


7  (  +  a]al,] 


(1 

G^l  -a^) 


4<;’  -  a  +  3  4(1  +  a") 

- - -  +  - T - 7 


+  -4  “  7 


+ 


4  ("(I 

Ow)  2 


+  2a% 


where 


Fig.  1.  Normalized  asymptotic  variance  avart  X  )/(<)’( \),  (37b),  versus  AR 
parameter  value;  $ienal-to-noise  ratio  is  one. 

(40) 


where  now 


7  =  {  1  +  2(a\/a]){\  -  +  {a]v/a])\\  -  a'*)}. 

From  (37b),  we  see  that  the  asymptotic  variance 
expression  is  composed  of  three  terms.  The  first  term 
( 1  / \)  V'  represents  the  contribution  due  to  esti¬ 
mating  a;,  the  second  term 

( 1  / Df  )’87rs0^(  X)  [cos  (X)  -  a] 

is  due  to  the  covariance  between  the  estimates  aj  and  d, 
and  the  third  term 

(l/a,)‘'(4ir)'^G<ii''(X)[cos  (X)  -  u] 


G  =  (1  -  a^)/a^ 
s  =  (a^/a^){(l  +  a^)(l  -  a^)| 


I  -f  a  -F  4<i^  +  2a^  -F  6a*  -F  2a^  -F  2a^^ 
a*(1  -h  a) 


(42c) 


On  the  other  hand,  for  the  classical  AR  spectral  estimate, 
which  uses  the  standard  Yule-Walker  equations,  the 
asymptotic  variance  is  again  given  by  (41),  but  with 


represents  the  contribution  due  to  estimating  the  AR  pa¬ 
rameter  “a.” 

We  see  that  even  for  the  AR(1)  case,  the  asymptotic 
variance  expression  for  the  spectral  estimate,  as  given  by 
(37b)-(40),  is  a  complicated  function  of  the  process  pa¬ 
rameters.  To  provide  insight  into  the  relationship  between 
the  asymptotic  variance  and  the  process  parameters  a,  aj, 
aiy,  and  X,  we  evaluated  (37b)-(40)  for  a  few  parameter 
cases. 

The  dependence  of  the  asymptotic  variance  on  the  sig- 
nal-to-noise  ratio  a,^/[(  1  -  a^)  a^]  is  fairly  clear  from 
the  expressions  (37b)-(40)  and  is  expected  to  be  mono¬ 
tonic.  Fig.  1  exhibits  the  normalized  asymptotic  variance 
avar  (  X )/<A‘(  X )  as  a  function  of  the  AR  parameter  “a” 
for  a  wide  range  of  frequencies;  the  signal-to-noise  ratio 
is  set  to  1.  More  interestingly,  we  wish  to  compare  the 
normalized  asymptotic  variance  avar  (  X)/0^(  X)  to  the 
classical  case  of  AR  spectral  estimation  with  no  noise.  If 
we  set  =  0  in  (37b),  we  have  for  our  spectral  estimate 
(13),  which  uses  the  high-order  Yule-Walker  equations, 

avar  (  X)  =  (4>"(  X)/ a^)  {  f  ^  -F  8irs(A(  X)  [cos  (  X)  —  a] 

-F  (47r)^G0^(  X)  [cos  (X)  -  a]  }  (41 ) 


C  =  (1  -  a^)  (43a) 

j  0  (43b) 

=  2ff^  (43c) 

(see  Akaike  (4j).  Fig.  2  plots  the  ratio  of  the  two  asymp¬ 
totic  variances  [(41)  in  conjunction  with  (42)  divided  by 
(41)  in  conjuction  with  (43)]  as  a  function  of  the  AR  pa¬ 
rameter  “a”  for  a  wide  range  of  frequencies.  It  can  also 
be  seen  from  (42)  and  (43)  that  this  ratio  tends  to  infinity 
as  a  -*  0  and  approaches  5  as  a  1 .  The  larger  asymp¬ 
totic  variance  of  our  spectral  estimate  is  basically  due  to 
the  use  of  the  high-order  Yule-Walker  equations  as  seen 
from  the  expressions  (42)  and  (43)  for  G  and  v". 

V.  Comments 

It  was  noted  in  the  introduction  that  the  results  of  Lee 
[8]  regarding  the  asymptotic  normality  of  the  AR  param¬ 
eters  in  a  multivariate  AR  plus  noise  model  are  not  sub¬ 
stantiated.  We  elaborate  on  this  point  in  this  section.  In 
order  to  prove  the  asymptotic  normality  in  question,  Lee 
[8]  invokes  Theorem  21.1  of  Billingsley  [9].  This  result 
establishes  a  central  limit  theorem  for  certain  nonlinear 
transformation  Vm  =  fi'  '  '  .  - 1 .  + 1 .  '  •  • )  of 


LOG  RATIO 
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.AR  P.ARAMETER 

Fig.  2.  Ratio  of  asymptotic  variances.  (41 1,  with  o;  =  0  divided  by  (41) 
for  the  noise-free  case  versus  .AR  parameter  value. 

statior.arv'  <i)-mixing  processes  {?,  }.  In  order  to  use  it. 
Lee  [8]  should  have  shown  that  his  observation  process 
{  V,  }  (an  ARMAlrV/,  M  )  process)  is  <t>  mi.xing  and  its 
mixing  coefficiem  tp,  satisfies 

X 

Z  0,'  '  ■  <  00 

I  -  1 

(Billingsley  [9.  Theorem  21.1]).  Lee  [8,  eq.  (AlO)- 
(Ai9)l.  unfortunately,  is  silent  on  both  points.  In  fact. 
Lee  could  nof  have  proven  that  these  two  conditions  are 
satisfied  since  it  is  known  (see  Gastwirth  and  Rubin  [16]) 
that  not  even  AR  processes  are  0  mixing.  Consequently, 
l.cc's  invticaiion  of  Theorem  21.1  of  Billingsley  [9]  is  not 
at  aM  siihsian'iated  and  neither  is  his  principal  result. 

VI.  Conclusions 

The  results  presented  in  this  paper  establish  the  joint 
asympiotie  noi  iiiality  of  AR  spectral  estimates  for  the  case 
of  noisy  observations  using  the  high-order  Yule-Walker 
equations;  a  pieeise  asymptotic  expression  for  the  vari¬ 
ance  of  the  liiuiting  distribution  is  obtained.  The  paper 
extends  the  previous  noi.se-free  work  of  Akaike  14]. 

The  assumption  of  normality  on  the  processes  { }  and 
{  W„ }  is  not  implicitly  required  to  obtain  asymptotic  nor¬ 
mality  of  the  spectral  estimate.  However,  in  case  these 
pnyeesscs  are  not  Gaussian,  the  asymptotic  covariance 
(17)  in  Theorem  1  for  the  estimates  pv  t  will  contain  an 
additional  term  involving  the  fourth-order  cumulant  of  the 
process  {  Y„}  (see  biiiiinger  [!2ir.  this  temi  will  propa¬ 
gate  via  Lemmas  2  and  3  to  the  asympurtic  covariance  of 
the  spectral  estimate  (  ^)- 

APPKNDtX  A 

Proof  of  Lemma  1:  By  (9).  we  have  R  = 
['■/v-, ]r;.=  i  By  Gcrsch  [13|.  the  matrix  R  is  nonsin- 
gular;  let  A?  '  =  1  w,  J  i .  Clearly . 

w,  ,  =  (-!)'  ''  det  [Sf,,  j/det  [R] 


where  Mj  ,  is  the  (i,  y  )th  cofactor  of  R.  The  matrix  R  is 
estimated  by  =  {rN.p^i-iVi.j=\  where  is  given  by 
(10).  Whenever  Rf^  is  nonsingular  with  probability  one, 
we  write 

where 

=  (-!)'  det  [Mn.,.,  ]/det  [R^  ] .  ( A1 ) 

By  Parzen  [15],  f.v,*  converges  to  r*  almost  surely  as  A/  -► 
oo;  hence,  det  [^,v]  converges  to  det  [i?]  almost  surely 
as  A(  -♦  00.  Since  det  [/?]  ^  0,  as  indicated  above,  we 
have  that  with  probability  one,  det  (/?/;]  ^  0  for  suffi¬ 
ciently  large  N.  For  such  an  (V,  (Al)  is  clearly  well  de¬ 
fined.  Since  det  ,  ]  converges  to  det  [A/, ,  ]  almost 
surely  as  A/  -*  oo,  we  have  from  (Al)  that 

‘i-.v.,.;  (-l)'"^det  [M,,,]/det  [R]  =  w,  , 

almost  surely  as  (V  -►  oo. 

Since  for  large  N,  dy  =  the  almost  sure  con¬ 

vergence  of  d^-  to  fl  as  (V  -»  oo  follows  from  the  almost 
sure  convergence  of  R.v'  and  Ay  to  /?~'  and  b. 
respectively.  C 

Proof  of  Lemma  2:  Define  the  vector  by 

ry  =  (dy  -  fl)  -  R  'D(c,  -  c).  (A2) 

By  Lemma  1 ,  /?,v’  exists  with  probability  one  for  large  A. 
Thus,  for  large  N,  we  can  write 

d.v  =  .R.v'K--  (A3) 

Using  (A3)  in  (A2),  we  get 

=  (Ry'bx  -  a)  -  R^^D{cs  -  c) 

=  Ry'ik-  -  Rya)  -  R  'D{cy  -  c) . 

By  the  definition  of  D  in  the  Ictuma  and  (I5a),  it  can  be 
seen  that  D(cy  -  c)  =  by  —  Rya,  thus, 

Vy  =  Ry'D{cy  ~  c)  -  R~'D{cy  -  c) 

=  {Ry'  -/?'')  D{Cy  -  c). 

By  Lemma  1,  Ry'  /?“'  almost  surely  as  A  -*  c*, 
and  by  Theorem  1,  A''’‘(c,v  —  c)  converges  in  distribu¬ 
tion;  thus,  by  (16a)  applied  to  each  component  of  t'y.  we 
have  that 

A'^VvI  0 

in  probability  as  A  -»  oo.  The  result  follows.  C 

Proof  of  Lemma  3:  By  (5),  (6),  and  (12).  which  exist 
for  large  A,  we  have 

p  p 

^.v,  -  =  -Z  ay^jfy  -  (l/tiy,,-)  Z  ay^jfs  f,  J 

F  P 

=  -(-1,  d.C)  t?y  -  (l/dy,,)(  -1.  d,0<?s 

+  (-l.a^)d  +  (l/a,)(-l.o')(/. 
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Expanding  1  /dv.p  in  a  Taylor  series 

l/4v>  =  l/op  +  (l/7,v)'(«v.p  -  cip) 
where  7v  e  (dvp.  a^).  we  obtain 

a'v  ,  -  a;  =  T^  +  T.  +  Ti 

with 

T,  ^  dl)  d,  +  (~\.  a^)  d  (A4a) 

T:  =  {  \  /lip)  [  -  (  -  1,  d  v  )  4v  +  (  -  1,  a^)  <?]  (A4b) 

T:  =  -  ( 1  /  >  V  )'( ij\.p  -  flp )  (  -  1 .  d  V  )  d^.  ( A4c ) 

We  first  show  that 

a’  'j  T,  +  B,  +  B:  I  -►  0  as  Af  -*  00  (A5) 

where 

B,  =  ((  -1,  dl)  -  (-1,  a^))d  (Aba) 

B:  =  {-l.a^){d,  -  d).  (Abb) 


We  have  by  i  A4a)  and  (Ab),  after  collecting  terms, 

A’’  '!  T|  +  B|  +  B;1 

=  y  'j((  -1,  a")  -  (  -1.  d^))(d,  -  d)\. 

(A7) 

Since  by  Lemma  1  we  have  |  (  -  1 ,  dv  )  -  (  -  1 .  )  | 

0.  and  by  Theorem  1 ,  A''  '( d^  —  d  )  converges  in  distri¬ 
bution  as  A’  -*  00.  (A5)  follows  by  (Iba). 

Next  we  show  that 

/V  -|  T;  -t-  B3  +  B4 1  0  as  A  -  00  (A8) 

where 

B3  =  (l/a,)((-l,  d,(.)  -  (-l.aO)<?  (A9a) 

B,  =  (l/ap)(-La^)(d,  -  d).  (A9b) 

We  have  by  (A4b)  and  (A9),  after  collecting  terms, 

A'  -|  T:  +  Bj  +  B,  I 

=  A'  '|(l/a,)  {((-1.  a") 

-  (~l.  dl))  ids  -  d)^\. 

The  result  (A8)  now  follo  ws  by  the  same  argument  em¬ 
ployed  earlier  for  (A7). 

Now  we  show  that 

A'  ']  T,  +  Bjj  -^0  as  A  -  00  (AlO) 

where 

^5  =  ( 1  /«p)‘{dv  p  -  a,)  (  -  1,  a^)  J. 

We  have 

A'  '1  T,  +  B,j  =  |[(l/ap)'(-l.  a^)d 

-  (l/7A)'(-l.d(  )  Jv] 

•  A'  ’(dvp  -  ap)\. 


As  A  -►  00,  we  have  d  -» <? almost  surely  by  Parzen  [15], 
ds  -*  a  almost  surely  by  Lemma  1,  and  N'^^id^p  -  Op) 
converges  in  distribution  by  Lemma  2.  Moreover,  - 
ap\  <  jd/v.p  “  Op  I  so  that,  as  A  -►  ym  -*  Op  almost 
surely  since  the  right  side  tends  to  zero  by  Lemma  1 .  The 
result  (AlO)  now  follows  by  (Iba). 

By  (A5),  (A8),  and  (AlO),  it  follows  that 

-  a;)  -  B,  -  B:  -  B, 

-  B4  -  B5 1  0  as  A  -*  00 .  (All) 

By  the  definition  of  B2  and  B4,  we  have 

A''’(B2  -h  B4)  =  a'  '-((-1.  a^)(r?,v  -  d) 

+  (l/ap)(-l,  «’’)(<?, V  -  d)) 

and  by  augmenting  the  vector  (  -  1,  a^),  we  write  this  in 
the  form 

A'  -(B,  -E  B4)  =  A'  -((-1,  a^,  0^) 

+  i)/ap){d^.  -1,  0^))(c,v  -  c) 

=  N'  \h]  +  hl)ics  -  c)  (A12) 

where 

/i,  =  (-1,  0^)^  (A13a) 

h:  =  {\/ap){d\  (A13b) 

Next  by  the  definition  of  Bj  and  B3,  we  have 

N'  -iB,  +  Bj)  =  (V'  -’{(d  +  (1/a,)  J)'' 

We  need  to  express  this  in  terms  of  (c^  -  c).  To  this  end, 
we  note  that  by  Lemma  2,  we  have 

A'-  [(-I,d0"-  (-l,a")^] 

r  0"  1  p 

-  ,  D(cv  -  c)  0 

-  H 

and  thus, 

p 

a'  'IB)  +  Bi  —  hi (c.v  —  c)  I  -♦  0  as  A  -♦  00 

(A14) 

where 

/  rT  0'  I 

h,  =  (^(d  +  (\/ap)d)  I  ^  ^  \d]  .  (A13c) 

Finally,  by  the  definition  of  Bs.  we  have 

A'  -B5  =  A'  ’[(l/«^)Tdsp  -  Up){-I,  a^)d] 
and  by  Lemma  2.  we  have 
a'  "j(dv,p  -  Up) 

-  {/?  'Z7]^(cv  -  f)|  -  0 


as  A  00 
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SO  that 

i\''  'jSs  -  /ij(cv  -  c)|  —  0  as  /V  -•  00  (A  15) 
where 

/I4  =  ( I  Av)'{(  -  1,  aM  (A13d) 

Thus,  with  h  =  +  hj  +  h^,  the  result  follows 

from  (All)  using  (A12)-(A15). 

Appendi.x  B 

In  thi.^  Appendix,  the  evaluation  of  the  covariance 
expressions  r'.  s,  and  G,  stated  in  (25),  (26),  and  (27), 
is  given.  The  following  lemma  is  needed. 

Lemma  Bl :  We  have 


(B5) 


a )  27r 


j  d\ 


0;  m  >  2p 
p 

ati  Tj  p  <  m  <  2p 

k  —  m  ~  p 
p  ~  m 

i  =  0 


1  4  2  r 

+  (T,  an^o. 


0  <  m  <  p 


b)  27r 


j  A(e-'^)  A{e‘^)  d\ 


m  >  p 


=  I  2  4 

\a]r„  +  at-  Z  +  aia]do,„-. 


A  =  0 
0  <  m  <  p 


J  A{e‘^)  Aie-‘^)  d\ 


p  -  \  n  -  m  \ 

^  -  in  -  m  ! 


+  +  a;T„ 


where  the  {  g*  }  ?  =  1  are  the  AR  parameters  of  (1),  (a,,  = 
~  1  ).  the  {  a,; }  A  0  are  the  coefficients  of  the  power  series 
expansion  for  I  /A(z}.  and  „  is  the  Kronecker  delta. 

Rroo/.-  In  the  course  of  the  proof,  we  require  the 
power  series  expansion 


\  /A(  z)  —  Z  ai,z\ 


k  0 


(Bl) 


Since  Atz)  is  a  polynomial  of  order  p  with  no  zeros  in 
I  I  <  1  },  then  the  expansion  exists  and  converges 
uniformly  in  |  z  |  <  1 . 
a)  Let 

r(m)=27rj  AHe'^)e'"'^4'\\)d\ 

=  T^(m)  Ti{m)  T^(m)  (B2) 


where  by  (2)  and  (3) 

T,{m)  =  (l/23r)  J  A^(e-'^)e'"'^dX  (B3) 

T,(m)  =  (l/22r)2aio^  \  dX  (B4) 

J-i  A{e  ) 

7'3(m)  =  (l/27r)aM  - - 7-3 

Evaluating  each  term  (B3),  (B4),  and  (B5),  we  get 

r,(m)  =  (aV2x)  Z  Z  a, a.  (  l/X 

[O',  m  >  2p 

p 

_  I  at  Z  p  <  m  <  2p 

\  k  -  m  -  p 

P 

,  at  Z  0  <  m  <  p. 

A  A  =  0 


(B6) 


Next 


TAm)  =  {2aWj2-.)  dX 

•J  - 1  A[ 


A{e‘^) 

and  by  (Bl)  and  exchanging  of  integration  and  summa¬ 
tion,  we  have 


-i{k  -j  ~m)X 


T^im)  =  i2aWj2n)  Z  Z  0*0.  [ 

k  —  0  j  —  0  J-T 

'^O;  m  >  p 

_  I  2ata]apa^^■,  m  =  p 


2ataf  Z  0  <  m  <  p. 

V  *  =m 

For  T^{m),  we  have 

.>nX 

7'3(m)  =  (a72,r)  — ^ ,  dX 

[/l(c'A] 

'0;  m  >  0 

cr^ofo-  m  =  0 

by  (Bl).  The  result  follows  by  (B2)-(B8). 
b)  Let 

Tim)  =  23r  J  ^ /I  (e' A  .4  (e -'")  X) 

=  7’|(m)  -I-  T2{m)  +  T^im) 
where  by  (2)  and  (3) 


dX 


(B7) 


(B8) 


(B9) 


rifm)  =  (l/27r)  fft'  I  /l(e'A/l(< 


(BIO) 
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T.{m)  =  {\/2-K)2a],a:^  e'"'^  d\  (Bll) 


B.  Evaluation  of  s 
Put 


T,{m)  =  (1/2 


S-, 


-i>nX 


Proceeding  as  in  part  a),  we  obtain 


r,(m)  = 


d\.  (B12) 


ri  =  27r  J  DUhf\\)d\. 

Then  by  (26),  s  =  and  we  evaluate  n  explicitly. 

Using  the  definition  of  the  vector  from  Lemma  3,  we 
have 

il^=2xj  {-\.a^,Qi^)  VD^f\\)d\ 

-  (2ir/flp)  j  (a^  -1,  0^)  f7£)V'(X)  JX 

+  2Tr  (rf^  +  (l/flp)  i^)\ 

•  DUD^f-{\)  d\ 

+  i^ir/al)  I  ^  ((  -1,  a^)  d)[R~'D]^ 

■  UD^f\\)d\ 

=  P[  +  P[+  P[  +  PJ.  (B19) 

For  p[  using  the  definition  of  U  and  D,  the  nth  element 
of  (  - 1 ,  )  UD^  is  given  by 

((-1.  a^,  0^)  UD^)^  =  Aie‘^)Aie-‘^)e‘^'’^"^"^ 

+  A\e‘^)  + 

Using  parts  a)  and  b)  of  Lemma  Bl,  we  then  have 

p 

(P[)„  =  -  ert  2  +  (B20) 

For  p[  using  the  definition  of  IJ  and  D,  the  nth  element 
of  (o^,  —1,0^)  UD^  is  given  by 

((a^  -1.  0’^)  VD)^  =  A\e-'^) 

+  /1(e“'^)/4(e'^)c-''''"'’\ 
Using  parts  a)  and  b)  of  Lemma  Bl,  we  obtain 

p 

(Pl)„  =  -{ow/op)  Z  -  {a;/ap)r„^^. 

k  =  n  *■  \ 

(B21) 

For  p[  using  (B16),  it  follows  that 

ro^  1 

P[  =  (d"  +  (l/n,)  J")  ,  B  (B22) 

.  R 

where  B  is  given  in  (B18).  For  Pj,  we  can  write 

Pi  =  {2-K/al)  I  ^  ({  -I.  a^)  <?) 

•  [R-']^DUD^f-(\)  d\ 


and 


T.im) 


Tiim)  = 


0;  m  >  p 

1  P-"* 

1  0%  Z 

k  =  0 

CO; 

m  >  0 

haia;: 

3 

II 

o 

^  ■> 

C  <r,  '■m; 

m 

U^r-Q  - 

2  2 

OwO^'y  m 

m  >  0 


(B14) 


(BIS) 


0^ 

R-' 


and  the  result  follows. 

c)  The  proof  follows  directly  from  that  of  part  b).  □ 

A.  Evaluation  of  G 

For  notationa!  convenience  in  the  calculation  below,  we 
will  not  display  the  dependence  on  X  for  the  matrix  {/.  Set 

B  =  2x  J  DUD^f-{\)  d\-,  (B16) 

then  G  =  /?  “'B(B  "' )^  by  (27).  We  evaluate  explicitly 
the  elements  [B]„  of  B.  We  denote  the  n,mth  element 
of  the  matrix  DUD^  by 

2p  2p 

[DUD^]  =  Z  Zd„kUt,d„, 

n,  m  =  1,2,  •  •  •  ,  p 

where  *  is  the  n,Arth  element  of  the  matrix  D  and  is 
the  ^'.yth  element  of  the  matrix  U.  Using  the  definition  of 
U  ( 15g)  and  D  (Lemma  2),  we  have 

n  ■*'  1  -*-p 

—  k  *-  n  - 


[DUb 


ik\ 


k  =  n  *■  \ 


m  \  p 

Z  fl 

y  =  rrj  1 


p  -  j  m  *■  M 


.M 


+  e 


=  Afe"^) 

+  A(e-'^)  A(e'^)e"''-'”'\ 


(Bl?) 


Substituting  (BI7)  into  (B16)  and  using  parts  a)  and  c)  of 
Lemma  Bl,  we  obtain  the  final  result: 

p -\n-m\ 

+  aW,K„  +  o]r„^^,  (B18) 
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and  by  (B16),  it  follows  that 


Pi  - 


S  a.r 

j=o  ‘  ^  ‘ 


(B23) 


Thus,  s  =  where  ii  is  given  by  (B19)-(B23). 

C.  Evaluation  of  v~ 

By  (25)  and  the  definition  of  A  =  /i,  +  At  +  ^3  +  *4 
[cf.  (A13)],  we  write 

r-  =  2ir  J  h'^Uh^^p\\)  d\ 

+  27r  j  h'^Uh2^i^\\)  d\ 

+  2ir  j  h'^ Uhif~{\)  d\ 

>rr  J  h^Uh,f-iX)d\ 


+ 


=  7,  +  Tt  +  Tj  +  74. 


(B24) 


For  7,,  we  have 


7,  =  2x  j  hlUh^^p\X)dX 
+  2ir  J  hlUh^4^\\)d\ 
+  27r  J  h]Uh^f-{\)d\ 
2x1  hlUh^f\X)dX 


+ 


=  ^11  +  7)2  +  7)3  +  7)4. 


(B25) 


Using  (A13a)-(A13d)  for  A,,  h^.  Aj,  and  A4,  applying 
Lemma  Bl,  and  using  P,  from  (B19),  we  obtain 


7,1  =  ow  +  (7^  +  CT^ro  +  utv  2  a*  +  2o\’a] 

li  =  0 


p 

V’  22 

4dj  Qj^Oti^  (J  ^J^’0 ^ 
k^O 


L:  =  ](  War)(T:r  -  atcp 


•¥  a ip  ai^ap_i(  2<7\pO'^ar 


k=0 


7,3  =  {d^  +  {\/ap)d^) 


0^ 


Tu  =  iWapY 


2  a  r 

j  =  o 


[^■']pPi- 


Similarly,  for  T2,  we  write 

T2  =  721  ^22  ^23  +  724.  (B27) 

Using  (A13a)-(A13d),  Lemma  Bl,  and  P2  from  (B19), 
we  get 

72,  =  7,2  (B28a) 

T22  =  i^/ol)^a%al  +  di  +  a^ro  - 

(B28b) 

0^  ^ 

R-' 


723  =  {d^  +  iWap)d^) 


h 


Z  ajr  J 

;  =  0 


7'24  =  (lAp) 

Using  (A  13c)  for  Aj,  we  write 


[/?’']pp2. 


(B28c) 

(B28d) 


f  h^UD^l 

- \ 

o 

_ 1 

J-T 

LR-'  J 

{d  +  (l/flp)  J)  ^l^\X)dX, 

J 

but,  by  (26),  we  have  that 

s^  =  2xj  hUD^(R-^ff^{X)  dX- 


thus, 

73  =  (0,  s^){d  +  (1/a,)  J). 
Using  (A  13d)  for  A4,  we  write 

74  =  2x(  h^U[D^{R-'V}il/apf 

V  -  r  ” 


(B2  0 


As  above,  by  (26),  we  obtain 


74  =  (s^)  fl/a,) 


Z  a  r 

L;=0  ‘ 


(B30) 


(B26a) 


(B26b) 

(B26c) 

(B26d) 


Thus,  v~  =  1  7,  where  the  expressions  for  7,  are  given 

by  (B25)-(B30). 
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